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Abstract 

The paper studies the expectation of the inspection time in complex aging systems. Under rea¬ 
sonable assumptions, this problem is reduced to studying the expectation of the length of the 
shortest path in the directed degradation graph of the systems where the parameters are given 
by a pool of experts. The expectation itself being sometimes out of reach, in closed form or 
even through Monte Carlo simulations in the case of large systems, we propose an easily com¬ 
putable lower bound. The proposed bound applies to a rather general class of linear programs 
with random nonnegative costs and is directly inspired from the upper bound of Dyer, Frieze 
and McDiarmid [Math.Programming 35 (1986), no.1,3-16]. . 
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1. Introduction and motivations 

The random shortest path problem may be a good model for describing the time to failure 
of very complex systems with various degradation schemes as for instance nuclear plants. In this 
section, we describe our motivations for studying such random shortest path problems. 

1.1. Problem statement 

Consider a complex system whose n degradation states have been identified by experts. Let 
node 1 represent the state where the system is considered as new and let node n be the state 
of unacceptable degradation. All maximum paths from any node of the graph end at node n as 
in the figure below. The system is supposed to possibly evolve from a degradation state to any 
neighbor in the corresponding connected directed acyclic graph. The transition time between 
any two given states is assumed to follow a Weibull distribution whose parameters are estimated 
if the number of observations is sufficiently large. Otherwise, it is possible to make Bayesian 
inference in order to combine the real data with some expert opinions. 

Assume we start with a brand new system. Then, evolution of the system starts in state 
1. Maintenance policies require that the system be inspected before reaching state n, i.e. unac¬ 
ceptable degradation. We represent this by a connected graph Q where \V\ = n and 

\E\ = m. Such examples of complex systems have been studied in [5|, y, ll|. Moreover, Chen et 
al. study the shortest path, in the maintenance optimization context, for some multi-state 
parallel-series systems. The problem posed in this paper is to provide a lower bound on acceptable 
inspection times. 
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Figure 1: Graph of degradation states with Weibull transitions. 


1.2. Inspection times and shortest paths 

In order to simplify the analysis, we assume that evolution inside the degradation graph, a 
Directed Acyclic Graph (DAG), proceeds following the rule that starting from one node i, the 
system goes to state j minimizing the transition time among neighbors of state i. Therefore, 
acceptable inspection times will be the times lower than the shortest path from state 1 to state 
n where each edge is weighted by its transition time. In general situations, we thus may ask for 

- an estimator of the expected length of the shortest path from 1 to n, 

- a confidence interval for the expected time path. 

This task is in general impossible to achieve because of the huge number of observations this 
should require in practice. The goal of this paper is to propose a lower bound on the expected 
length of the shortest path. 

The paper is organized as follows. Since shortest path problems are well known to be represen¬ 
table as linear programs, we will address in the next section the more general problem of deriving 
a lower bound to the expectation of linear programs with random costs. In the third section, 
we specialize the study of this lower bound to an appropriate linear programming formulation 
of the shortest path problem. Moreover, we show that in the case of exponentially distributed 
random costs, the Dyer-Frieze-McDiarmid upper bound is as bad as possible. The fourth sec¬ 
tion is devoted to the application to reliability theory as motivated by the introductory example 
above. In particular, the Weibull distribution is proved to satisfy the assumptions under which 
the proposed lower bound holds. 


2. Random linear programs 

Consider the linear program with random costs given by 

z = min c*x 

Ax = b (1) 

a; > 0 

where c is a random vector taking values on K”, A is a matrix in and 5 is a vector in K™. 

The expectation of Ci is denoted by and its variance by af. 

In the sequel, we assume that A is full rank and that the constraints of © define a polytope 
which is therefore a compact set. For any subset of {1,..., n}, we denote by Ab the matrix whose 
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column set is the set of columns of A indexed by B. We will also use the notation xb and cb for 
the vectors whose components are the components of x and c which are indexed by B. A set of 
indices B is called a basis if its cardinality is m and the matrix Ab is full rank. A basis is said 
to be optimal if there exists x* in MA such that x* is a solution to m and Xgc = 0 . 

Random linear programs have been investigated recently and many impressive results have 
been optained in the case of i.i.d. cost vectors. For instance, the assignment problem was inves¬ 
tigated in [3, i, i in the asymptotic regime. 

In this section, we propose a lower bound on the expected value of random linear programs 
in the spirit of the Dyer, Frieze and McDiarmid inequality The Dyer-Frieze-McDiarmid 
inequality is a powerful tool for the analysis of some linear programming and combinatorial 
optimization problems with random costs, as detailed in the monograph of Steele [HI- More 
precisely. The Dyer-Frieze-McDiarmid bounds reads as follows. 

Theorem 2.1. (Dyer-FFieze-McDiarmid) Assume that all the components of c in ([T]) are 
independent and nonnegative and there exists /3 G ( 0 , 1 ] such that 


E [ci I Cj > h] > E [ci] + Ph. 


Let x be a feasible solution of o. Let z* denote the random optimal value of O- Then, assuming 
E [ci] CCi > • • • > E \Cn] Xn- 


E[z*]</3-^^E[c,]x,. 

i=l 


The Weibull distributions W(? 7 , 7 ) {f] and 7 are respectively the scale and shape parameters), 
has density function 


fix) 


1 

V 




( 2 ) 


When the edges are Weibull distributed with shape parameters 7 ^ in the interval [1,2] for 
i = 1,..., n, we will see in Proposition 14.II 


E[ci I Ci > h] < E[ci] + Ph (3) 

with p = 1. Note that Dyer-Frieze-McDiarmid requires the reverse inequality instead, in order 
to hold. We will however use this property to obtain a lower bound on the expectation of the 
optimal value of random linear programs in Theorem l2.ll 

As in 0, we will need the following result which is well known to users of the simplex 
algorithm. 

Lemma 2.1. A necessary condition for a basis to be optimal is that 

Cflc > c%[A^b) (4) 

Definition 2.1. For a basis B, let Lb be the index set 

lB = {iG {1, ■■■,«} I (c^(A^)-Mbc)^ > 0} . 

Using this result and following the same reasoning as in the proof of the Dyer, Frieze and 
McDiarmid inequality in we obtain the following proposition. 


3 


Proposition 2.1. Consider the random linear program m with random cost vector c satisfying 
m with j3 G [1, +c»). Let B be a set of bases. Let Ib be the index set Xg = riggg Ib- Let x be 
any vector satisfying the constraints of m and such that 




= 0 . 


( 5 ) 


Then, we have 

^ ^ Pb^\.^b\xb- ( 6 ) 

Proof. Fix a basis B and let Eb be the event that B be optimal. Take any x satisfying the 
primal constraints. Then we have 

E[z\Eb\ =E[c%{AB)-^b\EB] 

= E[c^^{Ab)~^{AbxB + Ab-^xb-^) I Eb] (7) 

= E[c^gXB + c%{Ab)~^Ab'=xb'= I Eb]. 


But using (| 31 ) together with dS]), we have E[c^c | Eb,cb]xb'= < E[cga]xB'= +/?c^(Ag) ^Ab-=xb-=, 
and thus 


E[z I Eb] 


— E[cg I Eb]xb +E E[c^(Ag) I Eb,cb] ] Eb 


XB‘= 


> E[c*g I Eb]xb + ;g(^E[c^c | Eb] - E[c%c]^xb‘ 

= (^1 - |)e[c^ I Eb]xb + |E[c‘ I Eb]x - iE[c*gc]a;gc. 


( 8 ) 


Since /3 G [l,+oo) we can rule out the term — ^jE[c^ | Eb]xb and using the fact that 
E[cgc]xB'= = E[c*]a; - E[c%]xb, we get 


E[z I Eb] > ^E[c* I Eb]x - ^ ^E[c‘]a; - E[c%]xb'^ ■ 


( 9 ) 


Einally take the expectation over all possible bases to obtain 

E[^] > I Eb]x- ^Y.bPbB.[c*]x + ^Y.bPbHc%]xb 

( 10 ) 

= ^11bPb^[cb]xb- 

Restricting the summation to a special subset B of bases preserves the previous inequality and 
the proposition is proved. □ 

The result of this proposition is not completely satisfactory since the probabilities p b that B 
be an optimal basis are not known. In certain cases, efficient approximations of these probabilities 
can be obtained using a more precise expression of pg. Since in the case where the components 
of the cost vector c are independent we easily get such an expression from the conditions for 
optimality given in Lemma l2.ll The lower bound we thus obtain is summarized in the following 
theorem. 


Theorem 2.2. Consider the random linear program m with random cost vector c with inde¬ 
pendent coordinates. 

a. Let B be a basis for this program and for all j G B and i G B^, let atj = {{A^g)~^AB'^)ji. 
Then, we have 

Pb=E['[[ P{ci > CjUji I eg)]. (11) 

ies^ j^B 
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( 12 ) 


b. Let X be any vector satisfying and the constraints of m- Then 

P{ci > '^cjaji I cb)]E[cbYxb- 

^ BgB i^B'^ j£B 

Proof, a. Due to independence of the components of c, conditionally on the value of Cj, j G B, 
the events Ci > independent. Thus, the desired formula. 

b. Combine a. with ProDOsition l2.ll □ 

With these results in hand, we will now be able to turn to the more specialized case of random 
shortest paths in the next section. 


3. Random shortest paths 


3.1. Linear programming formulation 

The shortest path problem can be represented as an equivalent linear programming problem, 
as is well known Q- In [l^ . pp. 75-79] for instance, the shortest path problem is shown to be 
equivalent to 

mm CqX subject to Aqx = b and x > 0, (13) 

where cq is the column vector whose components are the transition times on each edge, Aq is the 
incidence matrix of the oriented degradation graph and b is the vector [—1, 0, • • • ,0,1]*, encoding 
the fact that we start the path at node 1 and end it at node n. Recall that the incidence matrix 
is constructed as follows. Its rows are indexed by the nodes of the graph while its columns are 
indexed by its edges with an extra column of all ones. In each column indexed by edge {i,j), set 
the component to -1, the j**' component to 1 and set all other entries to zero. For instance, 
the incidence matrix for the graph of figure 11.11 is given by 


Aq = 


-1 -1 -1 0 0 0 0 

1 0 0 -1 0 0 0 

0 1 0 1 - 1-10 
0 0 10 10-1 
0 0 0 0 0 1 1 


Any solution vector x* to this linear program whose components are binary, i.e. G {0,1} encodes 
a path whose edges correspond to the nonzero components of x*. The important property is 
that the matrix Aq is totally unimodular (TUM) which means that every square submatrix has 
determinant equal to -1, 0 or 1. This linear programming formulation of the problem has however 
a drawback : the incidence matrix is not full rank and the size of its kernel is the number of 
connected components of the graph Q. On the other hand, for our results to apply recall that 
we need the matrix A in m to be full rank. In order to remedy this problem, we introduce the 
extended incidence matrix A, given by 


A=[Ao\ e], 


where e is the vector whose components are all equal to one. For instance, the extended incidence 


matrix for the graph of figure 11.11 is 

given by 







' -1 

-1 

-1 

0 

0 

0 

0 

1 


1 

0 

0 

-1 

0 

0 

0 

1 

A = 

0 

1 

0 

1 

-1 

-1 

0 

1 


0 

0 

1 

0 

1 

0 

-1 

1 


0 

0 

0 

0 

0 

1 

1 

1 
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In addition, let c denote the extended cost vector [cq, 0]. Then, we get the following proposition. 
Proposition 3.1. The shortest path problem is equivalent to the linear program 

min X subject to Ax = b and a; > 0. (14) 

Proof. Let x be an optimal solution of the given linear program. Then, x satisfies the Karush- 
Kuhn-Tucker equations which are of the form : 


f 

c+[ I A* 
Ax = b 


u 

V 


= 0 , 


< a: > 0 

UiXi = 0 for i = 1,..., n 
Ui <Q 

Vj{a*x — = 0 for j = 1,.. 


m 


(15) 


where a* is the row of A and the vectors u G M" and v G K.™ are the Lagrange multipliers. 
More precisely, the multipliers that compose the vector u deal with the nonegativity constraints 
and the components of v deal with the others. The third equation is imposed in order to select 
the "active" constraints at optimality. In particular, it implies that if ^ 0 we must have 
Xn+i = 0. On the other hand, if Un+i = 0, a;„+i may be positive. In what follows, we show that 
Xn+i is always null which will readily imply that this linear program also solves the shortest path 
problem. 

Equations (fT^ determine a polyhedron in x R” x R™. Now assume that is 

a corner point of this polyhedron and that Un+i = 0. Since the matrix A is now full rank, the 
x-part of the corner vector satisfies 

Ax = b, 


and 


Xi = 0, i G Ix 


for some index set Ix of cardinality n + 1 — m. Now write these last nullity constraints Cx = 0 
for some appropriate matrix C. Then by Cramer’s rules, we obtain that the last coordinate x„+i 
is proportional to 


det 


( 


C 

[Ao\b] 


)■ 


On the other hand, we know that the sum of the rows of A is equal to zero and the same holds 
for the sum of the components of b. Therefore, the determinant just above is null. Therefore 
x„+i = 0 as announced. From this, it is easy to deduce that the vector of the first n components 
of an optimal solution to the present linear program also solves m- □ 

Using this proposition, we deduce that Theorem 12.21 applies to the random shortest path 
problem. We now consider the Dyer-Frieze-McDiarmid bound which gives an upper bound on 
the expected optimal value. 


3.2. The DFM upper bound 

The upper bound for the expected optimal cost of random linear programs Dyer, Frieze and 
Me Diarmid @ is a very nice result and a major contribution to the study of random optimization 
problems; see also [Ilj. It can be stated as follows. 
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Theorem 3.1. (@) Assume that the random costs Ci are independent and satisfy 


E[ci \ Ci > h]> E[ci] + ah 

for some a S (0, 1].0 Then for any matrix A S and any vector b S K", the optimal value 

z* of the general linear program satisfies 

E[z*] < E[c^]xi (16) 

for any feasible solution x, i.e. any x satisfying Ax = b. 

It is interesting to understand to what extent the Dyer-Frieze-McDiarmid (DFM) bound is 
useful for the shortest path problem. Surprisingly, the answer is that the DFM bound is as bad as 
possible in this case, despite is remarkable efficiency on other standard combinatorial problems 
as shown in [ill Chapter 4]. To understand why this happens, consider the deterministic problem 
where the random costs are replaced by their expected values. 

C = min 

Ax = b (17) 

x>Q 

Now, notice that whatever the distribution of the cost vector c may be, the following upper 
bound is immediate to obtain : 

E[z] < C. (18) 

The following proposition shows that the DFM bound is no better than this trivial upper bound. 


Proposition 3.2. Consider problem m where the random costs are assumed to be independent 
and exponentially distributed. Then the DFM bound is equal to the optimum value ^ of the 
associated deterministic program m- 

Proof. Take x equal to any binary vector minimizing (I17L It is clear that the number of ones 
in this vector is less than the number of nodes in the graph. Then, the maximum value over all 
sets S of cardinality n in the right hand term in ([THll is obtained when S is taken to be the set 
of indices i for which Xi = 1. Thus E[ci]xi is exactly the cost of a;, i.e. c). □ 

Contrary to intuition, replacing the random costs by their expected values is far from being 
a safe idea for the problem of providing efficient lower bounds to the mean inspection time. 


4. Application to reliability 

In this section, we address the problem of finding lower bounds to the inspection time of 
complex systems in reliability. As explained in Section [T] our main interest in studying random 
shortest paths problems relies in its possible application to the analysis of the time to failure 
for very complex systems. We will assume in this section that the transition times between two 
degradation states follows a Weibull distribution. In order to apply our previous results, we will 
need to study the Weibull distribution a little further. 


1. This property is obviously satistied with equality and o = 1 in the case of exponential transitions. 
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4-.1. Some properties of the Weibull distribution 

Let X be a random variable with Weibull distribution Weib(r]^ 7 ), i.e. with probability density 
function given by 

= (19) 

T] \r]/ 

Then, the mean residual time to failure (MRTF) is given by 

Gx{h) =E[X\X>h]= 77e(^)"r(l + (-)T'), (20) 

7 V 

where T(a,h) is the incomplete gamma function defined by 

T{a,h)= / E-^e-Ut. (21) 

Jh 


Lemma 4.1. Let X be a Weibull Weib{r],j) distributed random variable. Then, 

a. the first two derivatives of the MRTF for a Weibull distributed variable X are given by 


c:,,.)^,(i)’(p)’r(: + i,AVi) 

and 

G'kih) = -^/i(^-'’(l + 7(|)^) + 

^/,(7-2)e(^rr(i + y (^)'^) + 7 - 1 ). 

Moreover, 

b. when 7 > 1 we have 


lim Gx(/i) = 0 , lim G'x{h) = I and Gk{h) > Q. 

h—yO ?i—>+oo 


( 22 ) 


(23) 


(24) 


Proof, a. We omit the proof of the formula for the first and second derivative of Gx- 

b. Now, since Gk is clearly continuous on R+ and 0(^(0) = 0, we obtain the first assertion 
in b. Using the transformation u = t — {h/t])'^, the first of the two terms between parenthesis in 
can we written 



For all u > 0 we have the following Taylor expansion 



l + -^u + o(T). 
'yh'T ^h"t’ 


(25) 


(26) 


Multiplying by e “ and integrating, we obtain 


e + du = 


r+oo 


' du - 


1 77 ^ 
7 h'^ 


p-\-oo 


e “udu + o( —) 


= l + -^ + o(T). 
7 /iT' ^h'l' 


(27) 


Combining with (I22|) . we deduce that lim/i^+oo Gk{h) = 1. Finally, it is readily seen that G'k is 
positive as soon as 7 > 1 . □ 



4-2. The lower bound 

In this subsection, we work out an easily computable lower bound derived from Theorem 12.21 
We first have the following crucial result saying that the most commonly encountered Weibull 
distributions in reliability theory satisfy the main assumption of Proposition 12.11 and Theorem 

O 

Proposition 4.1. Assume that X has distribution Weib{r],"f) with 7 S (1)2). Then, for all 
h > 0, we have 

E[X \ X >h]< E[X] + h. 

Proof. This is a direct consequence of Proposition 14.11 □ 

In the next theorem, we derive an explicit lower bound from Theorem 12.21 in the case of 
Weibull distributions. 


Theorem 4.1. Consider the random linear program m with random cost vector c with inde¬ 
pendent components and assume that each component Ci, 1 < i < n follows a Weibull distribution 
Weib{rii,-fi) 

a. Let B be a basis for this program and for all j € B and i G B^, let atj = AB'^)ji- 

Then, we have 


PB i 1 - H 


4v^( T.,,b -fir(i + #))* + ! E«b «).P)r(i + i) | 




iT 


(28) 


b. Let X be any vector satisfying and the constraints of m- Then 


BeB 


(l 

^4^(E«e4’l|r(l + i))’ + 

'^j^B 

-1 


i vT 


) 


Xb- 

(29) 


Proof, a. Theorem I2.2[ a. gives the following formula for : 

^jeB 1 

— I iliclA. S U, 


Pb n exp-^max|o, — 


(30) 


where the expectation is taken with respect to the variables Cj, j € B. Now since exp(—x) > 1 —x, 
we obtain that 


Pb > E 




= l-E,eBpE[max{0,^i^^} 


Thus, 


PB 




E 


max|o,X;jgBajiCj} 


i^B‘> 


Vi 


(31) 


(32) 


In order to simplify the subsequent computations, we will use the crude majorization : 


max 


|0, OjiCj I < I <^3iCj\ 
JGB j&B 
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which gives 


PB 




E 




Ali 


i^B‘> 


Vi 


(33) 


Now, our next goal is to use the Kintchine inequalities in order to bound the last expression by 
a quantity expressed in terms of the I 2 norm which will be easier to control. For this purpose, 
one might want to center the random variables involved in (13311 and use the triangle inequality 
to obtain 


E 




7i 


= E 
< E 
= E 


Sjes E[cj] + E[cj])|'''‘ 




E 


Thi^B '^iiE[Cj] p 




(34) 


Using Jensen’s inequality, a standard trick gives 


E 


E 


yes ^3^y^3 


.(c,-E[c,])r^ 


= E 
< E 


i^3 ^ Wa ]) 




|7i 


(35) 


where c', j € B are i.i.d. variables independent of Cj, j G B and such that Cj has same distribution 
as c', j G B. Let , j G Bhe standard Rademacher ±1 random variables. Since Eyes ^ 3 i (^3 ~^j) 
has the same distribution as Eyes ^^^ 3(^3 ~ '^y)’ have 


E 


Eyes'^j*(‘-i E[cy])|'''* 


= E 
< 2E 


Ejes«sej(cy - Cy)P‘ 
I Eyes 


(36) 


where we used once again the triangle inequality. Notice that 


E 


IE 


yes ^3^’^3'^3 1 


= E 
= E 


E I 'Thj^B I Cy, J S R 

(e IEyes«seiCy|T'» | c^, j GB 


-V.; \ Ei"! 


On the other hand, Khintchine’s inequality gives 


E 


(e[|E 


yes 


,|7i 


Cy, j G B 


-y,- \ -y. 


< C^.E 


E,es4^|)^ 


where is equal to ESeE in the present context. Thus, 


(37) 


(38) 


E 


(e[iE 


yes I Cy, J G 73 


^^Y'] < E2iE(E[(E,es4c|)l] 


(39) 


Moreover, since p e-y E)!Xp] p is an increasing function and 7 ^ is assumed to belong to [1, 2], we 
obtain the simpler bound 


E 


(e[ie 


jeB j ^ ^ 


< 2 v^e[^ 


cp- (? 

3&B ^31 3 


(40) 


= 2 


3GBa%E[^3]) 
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Moreover, since E[c^] 



we have 


E 


(e[|E, 




L.J , 


j€B 


li 


<2v^E ^ 


cp- 

jeB ^ji^j 


Combining this result with (p^ . (IMl) . (IH^ . (pTT)) . and replacing E[cj] = TyjE^l + jn 
finally obtain the desired result. 

b. This follows from part a. and Proposition 12.11 


(41) 


( 1311 ), we 
□ 


5. Conclusion and perspectives 

In this paper, we derived a lower bound on the probability that a given path is optimal for 
the shortest path problem with independent arc weights with Weibull distributions. For this 
purpose, we used the linear pr og ramming formulation of the problem and extended the work of 
Dyer, Frieze and Me Diarmid . The results presented here are of a theoretical nature. Further 
refinements and applications to real data will be proposed in a subsequent paper. 
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